The Message Understanding Conferences
نویسنده
چکیده
The latest in a series of natural language processing system evaluations was concluded in October 1995 and was the topic of the Sixth Message Understanding Conference (MUC-6) in November, co-chaired by Ralph Grishman (NYU) and Beth Sundheim (NRaD). Participants were invited to enter their systems in as many as four different task-oriented evaluations. The Named Entity and Coreference tasks entailed Standard Generalized Markup Language (SGML) annotation of texts and were being conducted for the first time. The other two tasks, Template Element and Scenario Template, were information extraction tasks that followed on from previous MUC evaluations. All except the Scenario Template task are defined independently of any particular domain.
منابع مشابه
TIPSTER Program History
The third thread is the sponsorship of the international Message Understanding Conferences (MUC's) and Text Retrieval Conferences (TREC's). These conferences, which evaluated the state of the art and promoted text-processing R&D outside of the TIPSTER Text contracts, were organized by NRaD and NIST. MUC-1 and MUC-2 preceded and set the stage for TIPSTER, before the sponsorship of these conferen...
متن کاملEvaluation of Nasr Hamed Abu Zayd's interpretive approach in understanding the verses of the Islamic rulings
Hamed Abu Zayd, a contemporary scholar, believes that the message of the Quran can only survive through interpretation. In his view, the verses of the Islamic rulings should be interpreted in a modern way; From the development process of the Islamic rulings in the age of revelation, a message can be deducted through which modern rulings can be obtained. Since every understanding of the Qurchr('...
متن کاملEvaluation of Nasr Hamed Abu Zayd's interpretive approach in understanding the verses of the Islamic rulings
Hamed Abu Zayd, a contemporary scholar, believes that the message of the Quran can only survive through interpretation. In his view, the verses of the Islamic rulings should be interpreted in a modern way; From the development process of the Islamic rulings in the age of revelation, a message can be deducted through which modern rulings can be obtained. Since every understanding of the Qurchr('...
متن کاملOverview of the fourth message understanding evaluation and conference
The Fourth Message Understanding Conference (MUC-4) is the latest in a serie s of conferences that concern the evaluation of natural language processing (NLP ) systems. These conferences have reported on progress being made both in th e development of systems capable of analyzing relatively short English texts and in the definition of a rigorous performance evaluation methodology . MUC-4 was pr...
متن کاملWhither Written Language Evaluation?
Common evaluations have grown to be a major component of all the ARPA Human Language Technology programs. In the written language community, the largest evaluation program has been the series of Message Understanding Conferences, which began in 1987 [2,3]. These evaluations have focussed on the task of analyzing text and automatically filling templates describing certain classes of events. Thes...
متن کاملMessage Understanding Conference- 6: A Brief History
We have recently completed the sixth in a series of "Message Understanding Conferences" which are designed to promote and evaluate research in information extraction. MUC-6 introduced several innovations over prior MUCs, most notably in the range of different tasks for which evaluations were conducted. We describe some of the motivations for the new format and briefly discuss some of the result...
متن کامل